Sensitive Terms Behavior 



Abusive 

(sev=0) 

Sensitive 

(sev=1) 

Brand unsafe 
(sev=2) 

Examples 
x = blocked 
/ = allowed 

‘x rated’ 

'child porn’ 
"escorts' 

’shit sandwich ’ 

' cocaine ' 
'wetback' 

‘one night stand’ 
‘pans attack' 

’how to get a guy’ 
‘bum belly fat' 
‘cheap wedding gifts’ 

Autocompllete 

X 

X 

/ 

Results (Pins, Pinners, boards) 

X 

+ conditional 
advisory 

✓ 

+ generic advisory 

/ 

Guides 

• block all guides for a query 

• block from showing as a 
guide for any other query 

X 

X 

/ 

Recommended / Trending 

Queries 

X 

X 

X 

Recommended queries 

X 

X 

X 

Notifications (email, push) 

X 

X 

X 













FAQ 

What data is associated with terms in the sensitive terms list? 

* severity: Severity level of the sensitive term, which defines what products this term should be avoided. Lower value is more severe. Values are: 0 (Abusive), 
1 (Sensitive), and 2 (Brand Unsafe)* 

* advisory: advisory shown to the user for this term. Possible values are: 0 (CONDITIONAL), 1 {EATING_DISORDER), 2 (PORN), 3 (CHILD_SAFETY) f 4 
(EMOTIONAL_DISDRESS_OR_SUICIDE) P 5 (BUY_OR_SELL_WEAPQN_ILLEGALLY) i 6 (REPORTED_PINS), 7 (HATE_SPEECH) r 8 (EATING_DI$QRDER_FUNDING) . 
Default value is 0 when this field is not set. 

• Most up to date listing in SersitiveTermCategory Thrift struct, and messages in config/messages.py 

* emaiLnotificatiori_blGdked: This will block a term from showing in any automated marketing emails or notifications* Default value is false when it is not set, 

* excluded_CGuntries: Countries where we should not block this term. Default to be none. NOTE: This field is not used by most surfaces. 

* excluded .languages: Languages spoken by users for whom we should oof block this term. Default to be none. NOTE: This field is not used by most 
surfaces. 


Protection Policies 

We classify three levels of severity in sensitive terms, with different behaviors. 

• Abusive (severity = 0) 

• Sensitive (severity = 1) 

• Brand Unsafe (severity = 2) 

We also classify different types of advisory to direct pinners on undesired behavior via Search. 
Different advisory types surface different warning messages. 


Brand unsafe (severity = 2) 

• Description: Terms that Pinterest would not want to merchandise or promote 

• Behavior: Hide from recommended algorithms such as autocomp I ete, guides, 
trending or popular emails 

• Examples: 

o Policy 

o Negative emotions 
o Etc 





Severity 

For different severity levels, different behaviors are applied on the product. 

Abusive (severity = 0) 

* Description: Very explicit terms that are not compliant with our content policies. 

* Behavior: Search nag appears. No search results. 

Sensitive (severity = 1) 

* Descri ption: Borderline terms that comply with content policies but shouId trigger 
warnings. 

* Behavior: pins / boards/ pinners I auto-complete annotated with those words 
should be blocked, or heavily demoted. 

* Examples: 

* Reference: google autocomplete removal policy 

* Hate or violence related suggestions (missing from our guideline) 

* Personally identifiable information in suggestions 

* Porn & adult-content related suggestions 

* Legally mandated removals 

* Pi racy-related suggestions 







November 6, 2018 
Policy Quiz: Self Harm 

Slide Deck: 

https://docs.qooqle.eom/presenlHtian/d/1 JNdcroPiQYefl\AvAef8k3U eCtaL FIC4MGMqTdltqG5 

7 3/ed it?us p-s hari no 

Policy Decisions: 

* If pin seems not neutral, then strike: 

o Defending the act of self harm 
□ 'This is what I do. and I’m okay with that” 
o "I don’t need help 11 

o Any pin that would potentially keep others continuing with self harm 
q Think about: what is the mood and sentiment behind the pin? 

* Any pin that even somewhat supports the anti-vaccine argument or even questions the 
effectiveness of vaccines is a strike (from what Janett has seen, people who pin 
anti-vacc related pinson Pinterest don't the platform to discuss the nuances of vaccines, 
they more so use it to get a reaction out of others and to convince people to not vacc 
their kids, so strike) 

* Strike pin if the board seems collective/promotional of self harm, even if the pin isn't 
explicitly promotional 

* Items and things related to sex. hide 

* Hide: "if you get an abortion, you're a murder" - if you are of this political belief, you are 
this negative judgment 

* Hide gory abortion boards 

October 29, 2018 
Policy Area: Hate Speech 

Slide Deck: 

https: //docs.q ooo le. com/presentation/d/1 QQQsAmBAzU a KH Y1 ARftvIRG I p F2Q7G N o4a8AI M ES 

m7RYE/ed it#s I i de-id. a456Q9a0d72 Q 13 

Policy Decisions: 

* Remove jokes against rape victims as Hate Speech, until we can get better messaging 
in Graphic Violence 

* Silent remove Kavanaugh content 






Advisory 


Advisory 

Type 

Message 

0 

None 

WA 

1 

Eating disorder 

Are you struggling with an eating disorder? 

[Help is available.) 

2 

Porn 

Some nudity is okay for Pinterest. some isn't. 

Make sure you understand [our policies] before you Pin. 

3 

Child safety 

We don't tole rale c hi Id explo itation. We 'll re port you to 
the authorities if you Pin illegal content. 

If you're struggling with viewing this content, [seek 
confidential help.] 

4 

Distress or 
suicide 

If you're in emotional distress or thinking about suicide, 
[help is available.) 

S 

Weapons 

Just a beads up, trying to buy or sell weapons illegally 
goes against our Acceptable Use Pol icy 

Please make sure you understand [our policies] before 
you save pins. 

6 

Pinner reports 

Some Pinners have reported Pins from this search. 

Let us know if you see something thal goes against [our 
policies] 

7 

Hate Speech 

Its okay to disagree wilh people here, but Pinteresl isn't a 
place for hate speech. 

3 

Eating Disorder 
Recovery 

Funding 

If you're struggling wilh an eating disorder and you need 
financial aid treatment, please know that [help is 
available). 














EXCERPTS FROM PINTEREST'S "SENSITIVETERMS LIST" 


ytf'i ■+ {"email notificationblocked”:true,"advisory":2,"severity":0} xSUBSTRINGionline drug ■+ {"advisory": 0, "severity": 0, 
"lastupdate”: ”2018-05-29"} journaling ideas ■> {"advisory":0,'’severity":2} xcomo envenenarme ■+■ {"advisory": 4, 


"last_jjpdate": "2019-01-04"} xbokeb 2018 jepang {"advisory”: 2, "severity": 0, "last_update": "2019-03-01 "} xj A 6 X 5M* 
{"advisory":0,"severity":1} x^fH {"email_notification_blocked" :true, "advisory" : 3, "severity" :0} xjJJJg journaling -» 

{"advisory":0j"severity":2} xgovernment elections illustration {"advisory": 0, "severity": 1 3 "last_update": "2019-03-08"} xandrogel 


’severity”: 1, ”last_update”: ”2019-03-04”} x=wt {"advisory": 0, "severity": 1, "last_update": "2019-04-19"} x/\7fFn a n 


{"advisory”:2,"severity”:1} x 


bible 


verses ■+ {"advisory”:0,"severity”:2} -*■ {"advisory”: 2 3 "severity”: 1 3 "last^update 1 


'2018- 


{"advisory": 2 3 "severity" 
34-19"} xchristian 
{"advisory": 9, "severity" 


1 3 "last_update" 
{"advisory": 0, 
0, "last_update” 


"2018-09-11"} xnamo tv watch online -* {"advisory": 0, "severity": 1, "last_update": "2019 
severity": 2 3 "last_update": "2016-10-19"} xschwarze frauen mit dickem hintern -» 
"2019-01-15"} xpersone false -» {"email_notification": true, "advisory": 9, "severity": 0, 


-01-22”} xdillies for sale - {"advisory”: 10, 
{"email^otificationjslocked'' : true, "advisory” : 


"severity”: 1, ”last_update”: ”2018-12-14”} x 
0, "severity” : 2} xya^am sorunlan -+ {"advisory 


Christian 


_ tattoos -*■ 

0j "severity”: 2, 


”last_update”: 


”2019-03 









